Modern Data Formats for Big Bioinformatics Data Analytics

摘要

Next Generation Sequencing (NGS) technology has resulted in massive amountsof proteomics and genomics data. This data is of no use if it is not properlyanalyzed. ETL (Extraction, Transformation, Loading) is an important step indesigning data analytics applications. ETL requires proper understanding offeatures of data. Data format plays a key role in understanding of data,representation of data, space required to store data, data I/O duringprocessing of data, intermediate results of processing, in-memory analysis ofdata and overall time required to process data. Different data mining andmachine learning algorithms require input data in specific types and formats.This paper explores the data formats used by different tools and algorithms andalso presents modern data formats that are used on Big Data Platform. It willhelp researchers and developers in choosing appropriate data format to be usedfor a particular tool or algorithm.